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1 . Int  roduction 

Tong  (1975)  considered  the  problem  of  constructing  a fixed-width  confidence 
interval  for  the  largest  mean  from  k normal  populations  with  unknown  variance. 
His  procedure  is  a sequential  procedure  and  is  based  on  the  ideas  of  Chow  and 
Robbins  (1965).  However,  the  very  nature  of  this  k population  problem  is 
qualitatively  different  from  the  simpler  problem  constructing  a confidence 
interval  for  a mean  becuuse  the  user  has  the  flexibility  (not  found  in  Tong's 
procedure)  of  sampling  selectively  from  the  populations.  One  method  of  such 
selective  sampling  is  ,■  l initiation , where  a population  is  eliminated  from  further 
consideration  when  the  data  indicate  said  population  is  unlikely  to  be  associ- 
ated with  the  largest  mean. 

The  purpose  of  this  note  is  to  show  that,  using  the  ideas  of  Swanepoel  and 
Ceertsema  (1976),  it  is  easy  to  construct  a sequential  competitor  to  Tong's 
procedure  which  possesses  the  elimination  option,  achieves  its  intended 
coverage  probability,  and  can  lead  to  great  savings  in  sample  size  when  the 
population  means  are  not  identical.  When  the  population  means  are  nearly 
identical,  the  procedure  will  take  approximately  10%  more  observations  than 
Tong's  procedure,  a small  price  to  pay  for  possible  large  savings . To  this  end, 
in  Section  2 we  present  a Monte-Carlo  study  of  Tong's  procedure.  In  Section  5, 
we  introduce  the  elimination  procedure  and  study  its  small  sample  behavior  in 
a Monte-Carlo  study. 

2 • Tong's  Procedure 

Suppose  we  have  k populations  and  take  independent  and  identically  distri- 
buted observations  ...  from  population  i.  Define 


2 


n 


s = (k(n-l))  l £ (X. . - xfn^)^,  (pooled  sample  variance) 

n i=l  j=l  1J  1 

v(n) 


fn)  - i lx... 

1 n ,L,  li 


j = l 

We  will  assume  that  the  observations  from  the  ith  population  are  normally 

distributed  with  mean  p^  and  common  variance  a . If  p^  . . . <_  p^j  denote 

the  unknown  ordered  means,  the  goal  is  to  estimate  the  largest  mean  p„  . by  a 

[k  J 

confidence  interval  with  coverage  probability  y and  prescribed  fixed  length  L. 
Tong's  (1973)  sequential  procedure  is  of  the  following  form.  Let  <J>  be  the 
standard  normal  distribution  function  and  define 


cx^(c,x)  = min{<J>^(c-x)  - ^(-x),  $(c-x)  - <I>(-x) } 
sup  c^c.x)  * ( c , xQ ( c ) ) 

cQ(y)  = inf {c:  ctjjc.x^c))  >_  y}  . 

He  then  takes  N^,  observations  from  each  population,  where 

2 

N.p(L)  = smallest  integer  n ^ 5 such  that  n _>  (cQ(y)  s^/L) 
and  announces  the  following  confidence  interval  of  length  L: 

■<VL»  ' % - <L  - *o  \ * xo  sn/nt'‘>- 

where  x()  = x0(c^(y)).  Tong  shows  that 

Nt(L) 

lim  x ->■  1 (almost  surely) 

L-*0  (c0(y)  at ir 

lim  P{prtle  I (N  (L))}  > y for  all  p,,...,p.  and  o . 

L->0  lKJ  1 ik 

In  Table  1 we  present  values  of  = cp(y)  and  x^  = xq(cq(y))  for  various 


values  of  y and  k . 
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As  part  of  this  study  we  decided  to  investigate  the  small  sample  buhavior 
of  Tong’s  rule  hy  means  of  a Monte-Carlo  study,  he  studied  the  following 
configurations  of  means 


U1  * " \-l  " \ ' d 

l‘i«l  " ui  * J 1 k-1) 

with  d ■ 0.0,  0.5,  2.0.  We  chose  > • .90  and  l.  • 0.50,  1.00,  with  k » 2.3.5 
and  10.  The  results  are  reported  in  Tables  2 and  3.  It  appears  that  Tong's 
procedure  does  indeed  approximately  achieve  it  prescribed  coverage  probability. 
Note  however  that  the  average  total  number  of  observations  is  independent  of  d, 
the  spacing  of  the  means.  It  is  this  undesirable  feature  of  Tong's  procedure 
which  we  will  attempt  to  improve  upon  in  the  next  section. 

3 . I 1 1 m i na 1 1 on  Procedure s 

The  previous  section  makes  clear  that  while  Tong's  procedure  achieves  its 
coverage  probability  in  small  samples,  it  is  "data-blind"  in  the  sense  that  it 
takes  no  account  of  information  available  from  the  data  about  the  relative 
differences  among  the  means.  In  order  to  begin  to  design  a procedure  which 
will  take  the  data  more  fully  into  account  we  investigate  a procedure  which 
attempts  to  eliminate  early  in  the  experiment  populations  which  are  obviously 
not  associated  with  the  largest  mean. 

Ihe  idea  is  based  upon  a technique  due  to  Swanepoel  and  l.eert  sema  (197(0. 
Essentially,  if  we  desire  a coverage  probability  > and  set  (l-yl  1 (l-t^l  ♦ 1 1 - 1>1 
we  will  use  Swanepoel  and  Geertsema's  technique  (with  a minimal  sample  sire  of  51 
to  eliminate  populations  with  error  probability  at  most  (1-tO,  and  we  will  use 
Tong's  procedure  with  coverage  probability  ^ and  the  remaining  populations. 
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When  y ■ .90,  we  will  choose  Yq  = .92  and  3 = .98.  This  simple  grafting  of 
two  techniques  wil)  result  in  a procedure  which  is  slightly  conservative  when 
the  means  are  all  nearly  the  same  but  is  very  efficient  when  some  observations 
should  be  eliminated.  We  outline  the  steps  in  the  grafting  as  follows: 

Step  *1.  For  any  3 (typically  . 90_<  3 £ .99)  and  k,  choose  values  of  (a,t), 
where 

t = .2(1  ♦ a2/4)5 

1 - F4(a)  + a f4(a)  = (l-S)/(k-l)  , 


and  F4(f4)  is  the  distribution  (density)  function  of  a t distribution  with  four 
degrees  of  freedom.  The  values  of  (a,t)  are  given  in  Table  4. 

Step  *2.  Define 


H“(i, j ,n)=  -L-  j (X.  - X. 

v *■"  n-1  L,  ip  jp  l 


p=l 


x(n)  + xfn))2 

J 


h(3,n)  = [ (tn) 1/n  - 1]*»  . 


We  say  that  population  i is  eliminated  at  stage  n ^ 5 if  it  has  not  been  elimi- 
nated before  stage  n and  if 

xjn)  - xjn)  > h(3,n)  H(i , j ,n) 

for  some  population  j which  has  yet  to  be  eliminated  at  stage  n. 

Step  *3.  Choose  y as  the  intended  coverage  probability.  Let 

(1-6)  ♦ (1-Yq)  = 1“Y  • Take  five  observations  from  each  population.  Use  the 

Tong  procedure  with  Yq  if  = 5. 

Step  » 4.  If  N / 5,  eliminate  whatever  populations  you  can.  Suppose  there 
arc  k(>  populations  left. 
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Step  *5.  Take  another  observation  on  each  remaining  population,  so  that  there 

are  now  n observations  on  k^  populations.  Compute  and  as  in  Section  2 

2 

of  this  paper  based  on  and  k^.  Compute  s (n.k^)  = pooled  sample  variance 
on  the  k()  populations. 

Step  *6-  If  n s (c^  s (n , k )/L) “ , discontinue  sampling  and  announce  the  Tong 
confidence  interval  with  k^  populations. 

Step  *7.  Otherwise,  set  n = n>l  and  see  if  any  more  populations  can  be  elimi- 
nated. There  are  now  k^  populations  left.  Return  to  step  *5. 

In  Tables  5-8  we  present  the  results  of  a simulation  (with  200  iterations) 
of  the  elimination  rule  for  a fixed-width  confidence  interval  of  length  L for 


the  largest  normal  mean.  The  prescribed  confidence  level  is  y = .90,  and  we 
chose  y » .92,  8 = .98,  so  that  only  obviously  inferior  populations  were 
eliminated  from  consideration.  In  Tables  9 and  10  we  present  values  of  the  ratio 


tota 1 observat ions  used  by  Tong's  procedure  

total  observations  used  ¥y~the  elimination  procedure 


The  tables  make  clear  the  following  conclusions: 


(1)  The  elimination  rule  achieves  its  intended  coverage  probability. 

(2)  The  elimination  rule  results  in  approximately  10%  more  observations 
in  the  case  that  the  means  are  relatively  close  and  k is  small. 

(3)  When  the  means  differ  to  any  appreciable  degree  and  for  larger  k,  the 
elimination  rule  can  result  in  substantial  savings  in  the  number  of  observations 
taken.  For  example  if  k * 10,  1.  = .50,  d = .50  and 


U,  - Hj  = d = .50 
Uj  - p,  = d = .50 


I*  10  ‘ Vi9  - d * -5°  » 

the  elimination  procedure  takes  only  35%  of  the  total  observations  needed  by 
Tong's  procedure,  a dramatic  savings. 
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4.  Conclusion 

Wo  have  discovered  by  a simple  grafting  technique  a procedure  which  elimi- 
nates obviously  inferior  populations  early  in  the  experiment,  t.vas  leading  to 
possibly  dramatic  savings  in  sample  size  over  the  conventional  procedure.  We 
argue  that  elimination  methodology  is  easy  to  use  and  easy  to  study,  and  that 
the  savings  in  sample  size  argue  for  their  implementation. 
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Table  2 


Average 

number  of  correct 

decisions 

in  200  simulations 

of  Tong's 

procedure 

W1  = ••• 

= Mk-1  ' l‘k-d 

k 

2 

3 

5 

10 

d = 0.0, 

L = .50 

.900 

.900 

930 

.905 

d = 0.0, 

L = 1.0 

.905 

.910 

915 

.890 

d = .50, 

L = .50 

.890 

.930 

930 

.920 

d = .50, 

L = 1.0 

.930 

.925 

,975 

. 980 

d = 2.0, 

L = .50 

.890 

.925 

,920 

.900 

d = 2.0, 

1.  = 1.0 

.900 

.865 

910 

.890 

N.B.  The  average  sample 

size  x k 

(the  total  number  of  observations)  upon 

stopping 

is 

k 

7 

3 

5 

10 

1.  = 1.00 

21 

33 

59 

137 

l.  = . 50 

84 

132 

23S 

53S 

i 
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Table  3 

Average  number  of  correct  decisions  in  200  simulations  of  Tong's  procedure, 
Mi+i  - Ui  = d (i  = 1,  ....  k-1)  . 


k 

2 

3 

5 

10 

0.0 

L = .50 

.900 

.900 

.930 

.905 

0.0 

L = 1.0 

.905 

.910 

.915 

.890 

.50 

L = .50 

.890 

.925 

.925 

.900 

O 

tn 

L = 1.0 

.930 

.890 

.955 

.930 

2.0 

L = .50 

.890 

.925 

.920 

.900 

2.0 

L = 1.0 

.900 

.865 

.910 

.890 

1 
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Table  5 

Coverage  probabilities  for  elimination  rule  with  y = .90  and 
M1  * •••  = \-l  = \ ' d> 


k 

2 

3 

5 

10 

d 

» 

0.0 

L 

= 

.50 

.930 

.930 

.915 

.905 

d 

3 

0.0 

L 

* 

1.0 

.920 

.890 

.915 

.920 

d 

= 

.50 

L 

* 

.50 

.895 

.950 

.910 

.925 

d 

a 

.50 

L 

= 

1.0 

.950 

.940 

.980 

.980 

d 

=* 

2.0 

L 

= 

.50 

.880 

.935 

.895 

.890 

d 

s 

2.0 

L 

— 

1.0 

.880 

.880 

.915 

.910 

12 


Table  6 

Average  total  number  of  observations  for  elimination  rule  with  y = .90  and 


M,  » ... 

= Wk-1  " he  - d- 

k 

•> 

3 

5 

10 

k = 0.0 

L = .50 

94 

147 

264 

593 

d = 0.0 

L = 1.0 

25 

3b 

67 

152 

d = .50 

L = .50 

88 

141 

253 

575 

d = .50 

L = 1.0 

23 

36 

67 

152 

d = 2.0 

L = .50 

55 

67 

90 

160 

d = 2.0 

L = 1.0 

19 

30 

53 

120 

ruble  7 


Coverage  probabilities  for  elimination  rule  with  y ■ .90  and 
Ui+1  - Mi  ■ d,  i ■ 1, . . .,k-l. 


k 

4m 

3 

5 

d 

a 

0.0 

L 

s 

.50 

.930 

.930 

.915 

d 

a 

0.0 

L 

s 

1.0 

.920 

.890 

.915 

d 

X 

.50 

L 

X 

.50 

.895 

.940 

.895 

d 

■ 

.50 

L 

X 

1.0 

.950 

.946 

.960 

d 

s 

2.0 

L 

X 

.50 

.880 

.935 

.900 

d 

X 

2.0 

L 

X 

1.0 

.880 

.875 

.875 

14 


Table  8 

Average  total  number  of  observations  for  elimination  rule  with  y ■ .90  and 


e d,  i * 1, 

. . . ,k-l . 

k 

2 

3 

5 

10 

d » 0.0 

L - .50 

94 

147 

264 

593 

d * 0.0 

L =*  1.0 

23 

36 

67 

152 

d = .50 

1.  « .50 

88 

120 

150 

189 

Tab Jo  9 


Ratio  of  Tong 

“l  * = “k 

k 

•s  total 

-l  ■ l‘k 

sample  size 

- d. 

•> 

to  elimination  rule' 

3 

's  total 

5 

sample  size 

10 

d * 0.0  L 

x 

.50 

.89 

.90 

.90 

.91 

d = 0.0  L 

m 

1.0 

.91 

.92 

.88 

.90 

d = .50  L 

m 

.50 

.95 

.94 

.94 

.94 

d = .50  1, 

X 

1 .0 

.91 

.92 

.88 

.90 

r- 

N 

r j 

X 

.50 

1.53 

1 .97 

2 . t>4 

3 . 36 

d - 2.0  L 

X 

1.0 

1.11 

1.10 

1.11 

1 .14 

! 


16 


Table  10 


Ratio  of  TOng's  total 

sample  size 

to  elimination 

rule's  total 

sample  size 

ui*l  ' U 

i - d.  i = 1, 

. . . ,k-l . 

k 

2 

3 

5 

10 

d = 0.0 

L = .50 

.89 

.90 

.90 

.91 

d = 0.0 

L = 1.0 

.91 

.92 

.88 

.90 

d = .50 

L = .50 

.95 

1.1 

1.59 

2.85 

d = .50 

L = 1.0 

.91 

.92 

.97 

1.41 

d = 2.0 

L = .50 

1.53 

2.13 

3.26 

5.49 

d = 2.0 

L = 1.0 

1.11 

1.32 

1.64 

2.21 

